The suite is composed of various checks such as: Metadata Segments Performance, Prediction Drift, Train Test Performance, etc...
Each check may contain conditions (which will result in pass ✓ /
fail ✖ / warning ! / error ⁈) as well as
other outputs such as plots or tables.
Suites, checks and conditions can all be modified. Read more about
custom suites.
| Status | Check | Condition | More Info |
|---|---|---|---|
✖ |
Train Test Performance | Train-Test scores relative degradation is less than 0.1 | 6 scores failed. Found max degradation of 17.33% for metric Recall and class 1. |
✓ |
Prediction Drift | Prediction drift score < 0.15 | Found model prediction Kolmogorov-Smirnov drift score of 0.03 |
✓ |
Property Segments Performance - Train Dataset | The relative performance of weakest segment is greater than 80% of average model performance. | WeakSegmentsPerformance was unable to train an error model to find weak segments.Try supplying additional properties. |
Summarize given model performance on the train and test datasets based on selected scorers. Read More...
| Status | Condition | More Info |
|---|---|---|
✖ |
Train-Test scores relative degradation is less than 0.1 | 6 scores failed. Found max degradation of 17.33% for metric Recall and class 1. |
Calculate prediction drift between train dataset and test dataset, using statistical measures. Read More...
| Status | Condition | More Info |
|---|---|---|
✓ |
Prediction drift score < 0.15 | Found model prediction Kolmogorov-Smirnov drift score of 0.03 |
Search for segments with low performance scores. Read More...
| Status | Condition | More Info |
|---|---|---|
✓ |
The relative performance of weakest segment is greater than 80% of average model performance. | WeakSegmentsPerformance was unable to train an error model to find weak segments.Try supplying additional properties. |
| Check | Reason |
|---|---|
| Property Segments Performance - Test Dataset | `np.NINF` was removed in the NumPy 2.0 release. Use `-np.inf` instead. |
| Metadata Segments Performance - Train Dataset | Functionality requires metadata, but the the TextData object had none. To use this functionality, use the set_metadata method to set your own metadata with a pandas.DataFrame. |
| Metadata Segments Performance - Test Dataset | Functionality requires metadata, but the the TextData object had none. To use this functionality, use the set_metadata method to set your own metadata with a pandas.DataFrame. |